Papers by Young D. Kwon
Speculative Decoding with a Speculative Vocabulary (2026.findings-acl)
Copied to clipboard
| Challenge: | Speculative decoding methods use a draft model to accelerate inference while yielding identical outputs. |
| Approach: | They propose a method that selects a vocabulary subset per decoding step and uses a draft model to generate a series of tokens that are verified in parallel. |
| Outcome: | The proposed method achieves higher acceptance length than state-of-the-art speculative decoding method, EAGLE-3. |